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With the increasing kidney shortage crisis present 
in the United States that is further complicated 
with the occurrence of the COVID-19 pandemic, 
immediate solutions are required to both reduce 
kidney discard and increase the success rate of the 
transplants that do occur. Solutions accomplishing 
both goals may be found in the massively growing 
realm of artificial intelligence (AI) and its subfield 
machine learning (ML). While current clinical 
implementations are limited, significant efforts are 
being made across all of nephrology and related 
fields to utilize the powerful tool that is AI to 
improve patient care and outcomes across the 
board’. An area with especially high opportunity for 
the application of AI is renal transplant pathology. 
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kidney transplants is delayed graft function 
(DGF). The United Network for Organ 
Sharing (UNOS) defines DGF as the need for 
at least one dialysis treatment in the first 
week after transplantation?. A trained expert 
pathologist is able to analyze biopsies of 
donor kidneys and accurately predict the 


viability of the graft in isolation from clinical 


variables. This is done through recording 
fi 
aligrobar SALERS Mepeént Sclerosed 
Segmental Yes/No 
Sclerosis 
Interstitial Score: 0-3 
Fibrosis 
Tubular Atrophy | Score: 0-3 
Arterial Fibrosis | Score: 0-3 
ABR RTE PaOOUS E set The ent 
\ is to emulate ologist’s ability to 
HEPA Hg EO out this orm 


The availability of pathologists trained to the 
level needed to accurately assess a donor 


renal biopsy at any hour of the day is 
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progressing to more detailed than that and 
even fewer working on applications in 
transplant. Another important aspect of AI 
analysis of pathology is the stain used for 
visualization. The generally accepted best 
stain for AI is Periodic Acid-Schiff (PAS) stain 
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differentiation between different features. 
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The PAS stain is the most used stain in the 
literature for these reasons. Almost all renal 
biopsies are routinely frozen and stained with 
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Figure 1: Example frozen H&E stained 
renal biopsy 


The algorithm developed using the 


very 
accurately identify many different 


PAS stain was able to 
morphologic features of the renal 
biopsies. 
Glomeruli: Accurate 
identification and count within +1 
from the true number 
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Figure 4: Glomeruli segmentation masks example PAS 
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Arterial Fibrosis: Identifies by 
seeing increased intimal to luminal 
area ratio to give a scaled score 
from 0-3. Accuracy data pending but 
preliminarily optimistic. 

Arteriolar Hyalinosis: Can identify 


binary presence or absence with 


high accuracy 
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Figure 5: Interstitial fibrosis, tubular atrophy, and arterial 
fibrosis segmentation masks example PAS stained slide 


methodology and 


The second part of this project is to 
investigate the ability of H&E to be a 
valid stain to do everything that we were 
able to accomplish with the PAS stain. It 
is hypothesized that this can be done 
more accurately with scanning the slides 
using a fluorescence microscope to view 
the autofluorescence intrinsic to the 
H&E This trial compares the 


ability of AI networks to segment H&E 


stain. Figure 6: Example frozen H&E biopsy scanned with 


fluorescence microscopy with segmentation masks 


stained samples with 
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using the F1 score| which is a weighted 


hel netwoPk Xah that the cloe9HO number 


is to 1, the higher the accuracy of identification. In this study it was found that the 


networks trained and tested on fluorescence microscopy scanned samples 
performed significantly better across the board. This was especially apparent with 
with which the bright field 
visualization method struggled significantly. It should also be noted that although 


the identification of globally sclerotic glomeruli, 


the five-channel scan did perform better than the single channel in most categories, 


the results were ronel ston that the iN channel has ps oe as a 


This work has shown that artificial intelligence through the HALO AI software is 
currently in a state such that it can be applied to accurately segment a variety of renal 
morphologic features, and it has shown promise in the ability to do so even with the 
H&E stain through the use of autofluorescence. The next steps of this project are to 
further develop the H&E AI to the quality level of the one done on PAS through both 
giving more training samples and using expert pathologists to create the training 
regions for the AI. Once the network is developed to the point of clinical level accuracy 
of segmentation, it will then be used along with a parallel project to be able to 
automatically predict the chance of DGF occurring in any given renal transplant using 
just the biopsy and a few donor and recipient characteristics. 

The end goal is to have an affordable kit that can be bought by any hospital in 


pot gui tial e graft in their patient. 
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HALO AI is a collection of train-by-example 


classification and segmentation toolg 


underpinned by advanced deep lea 
neural network algorithms. HALO 
includes multiple pre-built AI networks, 

including their DenseNet V2 network - a pre-built 
densenet network with utilizes exceptionally 


dense and convoluted connections between 


layers, which was used in this project. The 


DenseNet V2's increased complexity over 


alternatives allows for the picking up of the most 
minute details in the tissue, given the drawback of 


Figure 2: Example of annotation of many different classes on a 


HALO was used to train semantic segmentation AI 
using the DenseNet V2 network on PAS-stained 
images from a data set of donor biospies for all 
fields described in Table 1 - background, tissue, 
globally sclerotic glomerulus, segmentally 
sclerotic glomerulus, Interstitial Fibrosis, Tubular 
Atrophy, Arterial 


Fibrosis, and Arteriolar 


Hyalinosis. Images were manually annotated 


similarly to that shown in Figure 2 for each class 


scripts to get numerical values for those that are 
numerical in Table 1 and binary for those that are 
binary. 


In order to combat Al’s inherent difficulties with 
frozen H&E stain, we investigated using the 
autoflouresence intrinsic to the H&E stain to 
analyze the biopsies. HALO was used with the 
same DenseNet V2 network to train semantic 
segmentation AI using the on three different 
imaging modalities - bright field, single channel 
fluorescence, and five-channel fluorescence - over 
the same regions of the H&E stained samples 
from a UAMS data set of donor kidney biopsies. 
Images were manually annotated for the 
segmentation categories background, tissue, non- 
sclerotic glomerulus, and globally sclerotic 
glomerulus in each imaging modality separately. 
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